A Sequence of Relaxation Constraining Hidden Variable Models
نویسندگان
چکیده
Many widely studied graphical models with latent variables lead to nontrivial constraints on the distribution of the observed variables. Inspired by the Bell inequalities in quantum mechanics, we refer to any linear inequality whose violation rules out some latent variable model as a “hidden variable test” for that model. Our main contribution is to introduce a sequence of relaxations which provides progressively tighter hidden variable tests. We demonstrate applicability to mixtures of sequences of i.i.d. variables, Bell inequalities, and homophily models in social networks. For the last, we demonstrate that our method provides a test that is able to rule out latent homophily as the sole explanation for correlations on a real social network that are known to be due to influence.
منابع مشابه
Coerced Markov Models for Cross-lingual Lexical-tag Relations
We introduce the Coerced Markov Model (CMM) to model the relationship between the lexical sequence of a source language and the tag sequence of a target language, with the objective of constraining search in statistical transfer-based machine translation systems. CMMs differ from standard hidden Markov models in that state sequence assignments can take on values coerced from external sources. G...
متن کاملBuoyancy Term Evolution in the Multi Relaxation Time Model of Lattice Boltzmann Method with Variable Thermal Conductivity Using a Modified Set of Boundary Conditions
During the last few years, a number of numerical boundary condition schemes have been used to study various aspects of the no-slip wall condition using the lattice Boltzmann method. In this paper, a modified boundary condition method is employed to simulate the no-slip wall condition in the presence of the body force term near the wall. These conditions are based on the idea of the bounce-back ...
متن کاملImproving Phoneme Sequence Recognition using Phoneme Duration Information in DNN-HSMM
Improving phoneme recognition has attracted the attention of many researchers due to its applications in various fields of speech processing. Recent research achievements show that using deep neural network (DNN) in speech recognition systems significantly improves the performance of these systems. There are two phases in DNN-based phoneme recognition systems including training and testing. Mos...
متن کاملConvex Relaxations of Latent Variable Training
We investigate a new, convex relaxation of an expectation-maximization (EM) variant that approximates a standard objective while eliminating local minima. First, a cautionary result is presented, showing that any convex relaxation of EM over hidden variables must give trivial results if any dependence on the missing values is retained. Although this appears to be a strong negative outcome, we t...
متن کاملLearning Discriminative Sufficient Statistics Score Space for Classification
Generative score spaces provide a principled method to exploit generative information, e.g., data distribution and hidden variables, in discriminative classifiers. The underlying methodology is to derive measures or score functions from generative models. The derived score functions, spanning the so-called score space, provide features of a fixed dimension for discriminative classification. In ...
متن کامل